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Abstract 

We introduce a generalization of the zig-zag product of regular digraphs (directed 
graphs), which allows us to construct regular digraphs with more flexible choices of 
the degrees. In our generalization, we can control the connectivity of the resulting 
graph measured by its spectral expansion. We derive an upper bound on the spectral 
expansion of the generalized zig-zag product. Our upper bound improves on known 
bounds when applied to the zig-zag product. We also consider a special case of the 
generalized zig-zag product, where one of the components is a trivial graph whose 
edges are all self-loops. We call it a reduced zig-zag product and derive a bound on 
the spectral expansion of its powers. 

1 Introduction 

A sparse graph which has high connectivity properties is called an expander graph. Ex- 
pander graphs have many applications, such as complexity theory ([16]), derandomization 
(PQ, [2]) and error correcting codes ([HI], [SO])- Connectivity properties of an expander 
graph are measured by several expansion parameters, which are related to each other. 
In this paper we consider the spectral expansion as a measure of connectivity. It can be 
interpreted as the rate at which a random walk on the graph converges to its stationary 
distribution. 

Many articles show that almost every regular graph has good expansion properties 
theoretically (pQ, [6]) or practically ([9], [IS]), based on randomization arguments. Also 
many authors proposed explicit construction of expander graphs using number theory or 
group theory ([7], [IT] . [12] . [13J). On the other hand, Reingold et al. [19] introduced a new 
graph operation called a zig-zag product and succeeded in constructing larger expander 
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graphs by iteratively applying the product. The zig-zag product requires two graphs 
and generates a graph which preserves the spectral expansions of the component graphs 
to some degree. Originally the zig-zag product was defined only for regular undirected 
graphs, but later Reingold et al. ([17]. [TB] ) extended the definition to directed graphs 
with an application to complexity theory. 

In this paper, we introduce a generalization of the zig-zag product of regular directed 
graphs. It requires three graphs and also controls the resulting spectral expansion in terms 
of the spectral expansions of the three components. We derive an upper bound on the 
spectral expansion of the generalized zig-zag product. Our upper bound improves on the 
bounds in Reingold et al. ([17], [IB]) when applied to the zig-zag product. Additionally we 
consider a special case of the generalized zig-zag product, where one of the components is 
a trivial graph whose edges are all self- loops. We call it a reduced zig-zag product. The 
spectral expansion of the reduced product itself is 1, which is the worst case. However we 
derive a bound for the powers of the reduced product, which is similar to the bound in 
the generalized zig-zag product. 

The organization of this paper is as follows. In Section 2 we give notations and 
preliminary definitions. In Section 3 we define the generalized zig-zag product and related 
graph operations. In Section 4 we derive an upper bound for the spectral expansion of the 
zig-zag product and the powers of the reduced zig-zag product. In Section 5 we present 
some results of numerical experiments to compare the spectral expansion of the zig-zag 
product and its bound given in Section 4. 

2 Notation and Preliminaries 

In this paper, we consider digraphs which may have multiple edges and self-loops. In 
a digraph, the outdegree of a vertex is the number of edges leaving the vertex, and the 
indegree of a vertex is the number of edges entering the vertex. A digraph is M-outregular 
if every vertex has the outdegree M, and M-inregular if every vertex has the indegree M. 
A graph is M-regular if it is both M-outregular and M-inregular. 

Given an M-regular graph G on the set of vertices [N] d = {1, . . . , N}, consider a 
random walk on G described by the transition matrix A whose (f,u)'th entry is the 
number of edges from u to v , divided by M0. Let ljy = (1, . . . , 1) T G M. N denote the 
N- dimensional vector consisting of l's. By the regularity of G, it = 1n/N is a stationary 
distribution of the random walk, i.e. Air = it. Also note that 1%A = 1% by the regularity 
of A. 

We are interested in the rate at which random walks on G converge to a stationary 
distribution it. The convergence rate can be studied in terms of the Euclidean norm on 
M. N . Let (x,y) = YlvelN] x vVv an d ||ac|| = \/ (x, x) denote the standard inner product 
and the standard Euclidean norm in M . We characterize the rate of convergence by the 

1 Often the transition matrix is denned to be the transpose of our definition. Following the recent 
literature on the zigzag product we adopt the the present definition of A. In our definition the transition 
of probability vector x by one step of the random work is expressed by left-multiplication Ax of x by A. 
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following parameter called the spectral expansion. 

Definition 2.1 (spectral expansion). Let G be a regular digraph on the set of vertices 
[N] and let A be the transition matrix of the random walk on G. The spectral expansion 
of G is defined as 

X(G) = max -r — 77-. 

x±l N \\x\\ 

In the case that G is undirected, X(G) is the second largest eigenvalue (in absolute 
value) of the symmetric matrix A ([3], [8]). In general, following Fill [5] and Mihail [H], 
X(G) is the square root of the second largest eigenvalue of A T A, which also means the 
second largest singular value of A. If p is our initial distribution, then p — TT and A(p— ir) 
are orthogonal to ljv. Therefore 

- tt|| = \\A\p - tt)\\ < X(GY ■ \\p - tt\\, 

and the distance to 7r decreases exponentially at least with the rate of X(G). In particular, 
if X(G) < 1, then tz is the unique stationary distribution. 

In our analysis, we make use of the singular value decomposition of the transition 
matrix. The singular value decomposition of A is 

A = PY,Q T 

where P, Q are orthogonal matrices and S is a diagonal matrix. We denote P = (pi, . . . , Pn), 
Q = (gi, . . . , q N ) and £ = diag{cr 1 , . . . , a N ). Then, for v G [N], p v and q v are the left- 
singular and the right-singular vectors for a v , respectively (i.e. Aq v = a v p v and A T p v = 
a v q v ). By the regularity of G, A1 N = A T 1 N = 1, and we set o~\ = l,pi — q± — ljv/viV. 
Then, since q^ . . . , q^ _L ljv, X(G) is the second largest singular value. 

For vectors x G M. N and y G M M , we define their tensor product x <8> y to be the 
vector in M. MN whose (u, fc)'th entry is x u yk- Similarly, for an Af x iV matrix A and an 
M x M matrix B, we define their tensor product A ® B to be the MN x MN matrix 
whose ((v, I), (u, fc))'th entry is A vu B lk . Then (A <g> B)(x ® y) = (Ace) ® (Sy). 



3 Operations on Directed Graphs 

In this section, we define some graph operations. To define them, we give distinct labels 
to the edges leaving and entering each vertex by numbers from 1 to M, which is called the 
two-way labelling. Let G be an M- regular digraph on the set of vertices [N] . A two way 
labelling of G is a family of bijections from [M] to the set of edges leaving each vertex and 
the set of edges entering each vertex. Such a graph together with its two-way labelling can 
be specified by a rotation map Rote : [N] x [M] — > [N] x [M], where Kota(u, k) = (v, I) 
if the k-th edge leaving u is the Z-th edge entering v. 

First, we define a generalization of the zig-zag product introduced in [TjJ]. Let G be 
an M-regular digraph on the set of vertices [N], Hi be a Di-regular digraph on the set 
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of vertices [M] and H 2 be a Z^-regular digraph on the set of vertices [M\. Their zig- 
zag product, denoted by G®(H 1 , H 2 ), is defined to be the graph on the set of vertices 
[N] x [M] whose edges are defined as follows: we connect two vertices from (u, k) to (v , I) 
if it is possible to get from (u, k) to {v , I) by a sequence of the following three steps: 

Step 1. Move from (u, k) to (u, k') where (k, k') is an edge in Hi. 

Step 2. Move from (u, k') to (v, I') where, in G, the k'-th edge leaving u is the Z'-th edge 
entering v. 

Step 3. Move from (v , I') to (v , /) where (V, I) is an edge in H 2 . 

Step 1 and 3 change the second component of the current vertex as a transition of the 
random walk on Hi and H 2 , respectively. Step 2 is a deterministic transition using the 
two-way labelling of G. Therefore their zig-zag product G@(Hi, H 2 ) is .Dif^-regular. The 
two-way labellings of H 1 and H 2 are used to define the two-way labelling of G@(H 1 , H 2 ) 
through their rotation maps. The formal definition of the generalized zig-zag product is 
as follows. 

Definition 3.1 (A generalized zig-zag product). Let G be a two-way labelled M -regular 
graph on the set of vertices [N] with a rotation map Rote, Hi be a two-way labelled 
Di-regular graph on the set of vertices [M] with a rotation map Rot^ and H 2 be a 
two-way labelled D 2 -regular graph on the set of vertices [M] with a rotation map Rot# 2 . 
Their zig-zag product G@(Hi, H 2 ) is defined to be the DiD 2 -regular graph on the set of 
vertices [N] x [M] whose rotation map Rot G @( HltH2 ) : ([N] x [M]) x ([Di] x \D 2 }) — > 
{[N] x [M]) x {[Di] x [D 2 ]) is as follows: Rot G@{Hl;H2) {(u,k),{i,j)) = {{v,l),{if,j')) if 
there exist k', V G [M] such that 

(k',i') = Rot Hl (k,i), M') = Rot G (u,k'), (l,f) = Rot H2 (l',j). 

Next, we consider a special case of the generalized zig-zag product where H 2 is a trivial 
1-regular graph with a single self-loop for each vertex. We denote this trivial graph by 0. 
Then we define the reduced zig-zag product of G and H by 

G®'H = G®(H,0). 

Here G is an M-regular digraph on the set of vertices [N] , if is a D-regular digraph on 
the set of vertices [M] and the reduced zig-zag product G®'H is a _D-regular digraph on 
the set of vertices [N] x [M] . The motivation to consider the reduced zig-zag product is 
that the degree of G@'H is only D and it still has good connectivity properties as an 
expander graph as shown below in Theorem 14.21 

In the reduced zig-zag product, the third step of connecting edges in the zig-zag 
product is omitted and the edges are defined as follows: we connect two vertices from 
(w, k) to (v, I) if it is possible to get from (u, k) to (v, I) by a sequence of the following two 
steps: 
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Step 1. Move from (u, k) to (u, k') where (k, k') is an edge in H. 

Step 2. Move from (u, k') to (v, I) where, in G, the fc'-th edge leaving u is the Z'-th edge 
entering v. 

The formal definition is as follows. 

Definition 3.2 (Reduced zig-zag product). Let G be a two-way labelled M -regular graph 
on the set of vertices [N] with a rotation map Rote and H be a two-way labelled D- 
regular graph on the set of vertices [M] with a rotation map Rotn- Their reduced zig-zag 
product G@'H is defined to be the D-regular graph on the set of vertices [N] x [M\ 
whose rotation map Rot G ®'H ■ ([N] x [M]) x [D] — > ([N] x [M]) x [D] is as follows: 
Rotc@/if((u, k), i) = ((v,l),j) if there exist k! G [M] such that 



In addition, we define the t-ih power of a graph, which only replaces the edge set with 
the set of all walks of length t in the graph. 

Definition 3.3 (Powering). Let G be a two-way labelled M -regular graph on the set of 
vertices [N] with a rotation map Rot^. The t-th power of G is the M t -regular graph 
G l on the set of vertices [N] whose rotation map Rote* : [N] x [M]* — > [N] x [M] 4 is 
defined by Rot G t(v , (k ± , k 2 , . . . , k t )) = (v t , (l t , l t -i, h)) where (v h k) = Rot G (uj_i, fcj) 



If we denote the transition matrix of G by A, then the transition matrix of G t is A 1 . 

4 Upper Bounds for Spectral Expansion 

In this section, we derive upper bounds for the spectral expansions of the generalized 
zig-zag product and the reduced zig-zag product. 

4.1 The Generalized Zig-zag Product 

First, as the main result of this paper, we derive an upper bound for the spectral expansion 
of the generalized zig-zag product. 



Theorem 4.1. If X(G) < a, A(i?i) < A and \{H 2 ) < (5 2 , then X(G®(H U H 2 )) < 
/(a,/3i,/3 2 ), where 



(k',j) =Rot Hl (k,i), (v,l) =Rot G (u,k'). 



for i = 1,2,..., t. 



f(a,[3 1 ,[3 2 ) = ±U, 




(1) 



5 



Remark 4.1. By definition < a,Pi,(3 2 < 1 awd 




(3l){l - Pi) + (fr + ft) 2 = (1 + ftft) 2 - (1 

<(l + A/3 2 ) 2 . 



a 2 )(l-ft 2 )(l-ft 2 ) 



Similarly 



a 2 (l-ft 2 )(l-ft 2 ) + (ft-ft) 2 <(l 



ftft) 2 - 



Therefore 



/(«,ft,ft) < -{ v / (i + A/3 2 ) 2 + V / FMF} 



i 



TOi/i equality holding if and only if 



o = (1-00(1-00(1 -&). 



(2) 



The rest of this section is devoted to the proof of ([I]). 

proof. Let A, B\ and _B 2 be the transition matrix of the random walk on G, Hi and 
H2, respectively. To analyze \(G@(Hi, H2)), we express Z, the transition matrix of 
G@(Hi, H2), in terms of G, Hi and H 2 . We can decompose Z into the product of three 
matrices, corresponding to the three steps in the definition of the edges of G@(Hx, H 2 ). 
Let Bi denote the transition matrix corresponding to the first step. The first step is only 
concerned with the the second component of [N] x [M\. Hence it is easy to see that 
Bi = Jtv <8> Bi, where In is the N x N identity matrix. Similarly, we have B 2 = In ® B 2 
where B 2 is the transition matrix corresponding to the third step. Let A be the transition 
matrix corresponding to the second step. Then A is the permutation matrix corresponding 
to Rote, i.e. -*4.(v^),(«,t) = I{Rotc(u,i) = (v,j)} where !{•} denotes an indicator function 
which takes 1 if the condition in the braces is true and otherwise. Thus Z is written as 



Our aim is to show that \\Zx\\ < /(a, Pi, ft)||a?|| for every x _L Imn- In view of the 
decomposition Z = B 2 ABi, we define 



For every u G [N], we define x u e R M by (x u ) s = X( U)S y Then, x = J2 u eu ® x v wriere 
e u — (0, ... ,0,1,0, ... , 0) T denotes the u-th standard basis vector in M. N . Every 
decomposed (uniquely) into x u = x^ + x^ where x^ is parallel to 1 m and x^ is orthogonal 
to 1m- Thus, we obtain a decomposition x = x n + x 1 - where 



Z = B 2 ABi = (I N ® B 2 ) A (I N ® B ± ). 



y = B x x, z = Ay, w = B 2 z. 




a 



a 
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tc 11 can also be written as a?" = x®l M) where x e R N is defined by x u = (1/M) X) s g[M] x (u,s)- 
Since a; and a;- 1 are both orthogonal to 1m n, so is x 11 and hence also x is orthogonal to 
In- We decompose 2 and w in the same way as x. 

We now show several relations among x, y, z and w. First we consider the relation 
between x and y. Since 

2/ = B x x 

= B lX ]] + B x x L 

u6[iV] u6[AT] 

and Bix\ = x\ \\ 1 M , B x x^ _L 1 M for every w, we have y = x v and t/- 1 = B 1 x ± . Note 
that || = || Bi x^ || < Pi || x^|| for every u G [M]. Thus, we have 

||y"|| = IMI, M < Alki. (3) 

The relation between z and w is similar and we have 

Hm? 11 !! = ||z"||, Hw^H < P 2 \\z ± \\. (4) 
Now consider the relation between y and z. Since A is a permutation matrix, we have 

||z|| = \\Ay\\ = \\y\\. (5) 



Furthermore for v E [N] 



M 

je[M] 

je[M] (u,i)e[N]x[M] 

JjYl H^a(u,i) = (v,j)}y u 
ue[N] i,je[M] 

E| the number of edges from u to v\ 
M Vu 

ue[N] 

ue{N] 
(Ay) v , 



and \\Ay\\ < a\\y\\. Therefore we have 



\\(Ay*y\\ = \\(Ay*)®l M \\ = \\Ay ® 1 M \\ < a\\y ® 1 M \\ = a\\y" ||. (6) 
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We will now prove ||io|| < f(a, (3\, j32)\\x\\ considering two cases, depending on the 
size of the norm ||aj"||. 

Case 1: Ha; 11 1| > a||cc|| 

Since \\y n \\ = \\x n \\ > ot\\x\\ > at\\y\\ and hence \\y \\ < \/l — a 2 \\y\\, we have 

d \\V ± \\ 

1 > 0. 

VT^a 1 WW ~ 

Using this, the triangle inequality yields 
= llW+V" 1 )}"!! 



A- 1 



a \\y- 



< 1 



\\y 

a \\y L 



y 



A 



oc \\y \\ n i 

"?/"+?/ 



\\(Ay*y 



A 



VT^ 2 \\y 

a \\y L 



Vi^a 2 II?/ 11 



Vl^a 1 II?/" 

From ([6]) the first term of the right hand of ([7]) is bounded by 

a \\y ± \\ \ M/ r || mi I, A ex \y- 



-y +y 



l 



Vi - a 2 ||?/ [l 



IIW)"II< i 



VT^ 2 yll 



' a ll2/l 



and from ([5]) the second term is bounded by 



• (7) 



.4 



a \\y^ 



Vi - « 2 II?/" 



-?/' + y~ 



Therefore we obtain 
1 1 11 II < ( 1 



" IT 



Vl^ 1 ||yll 



a 



a\\y" 



a 



Vl^ 2 



12/" 



a 



|?/"|| + vi — ct 2 ||i/ J 



< 



.4 



" V+?/ 



VI -a 2 II?/ 11 



a \\y~ 



VI -a 2 II?/ 11 



?/' + y 



a\\y n 



a II?/ 



Vl - a 2 II?/" 



-?/'+?/ 



a ||?/- 



ii?/ 11 



I?/ 11 



I?/ 



IT 1 " + 



I2T 
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Thus, from (JSJ), ®, © and (jSJ), ||iu|| is bounded as follows: 



\w\ 



= \\w ll \\ 2 + llif- 1 !! 2 
< ||«"|| 2 + ^||« x || 2 

= (l-/3l)||^|| 2 + /3 2 2 ||z|| 2 



< (l-^)(a||y ll || + VT^2||y 



2ll„-Lina 



%\\v\ 

\2 i all 



< (1 - /3 2 2 )(a||x"|| + v 7 !^ 2 . ^II^H)^ + ^(Hx 11 !! 2 + /?jf||a: 



(a 2 + # - a 2 /? 2 )||*l 2 + (ft 2 - a 2 fr' + n 2 ?f ^U^" 2 
+2a/? lV / l-a 2 (l-/3 2 )||a; ll || • ||ar 



(9) 



Now, it is straightforward to maximize the right hand side of (EJ) subject to ||a?"|| 2 + 
|| x ± || 2 = || a; || 2 by the Lagrange multiplier method and we obtain 



\w\\ 2 < - o^l -#)(!-#) + + 



+ y> 2 (l - (3f)(l - ft) + (fix + /3 2 ) 2 } ■ K(l - (3f)(l - ft 2 ) + (ft - ft) 2 } 
= UVa 2 (l-ft 2 )(l-ft 2 ) + (ft + ft) 2 



\x\ 



+^ a \i-p!)(i-p!) + (p 1 -p 2 y 

= f(a,p u p 2 ) 2 \\x\\ 2 . 

Case 2: Ha?" || < a||a;|| 

From (jlj) and (j5J), we have 



I ■ 1 2 ^ II i|2 

iu < \\z\\ 



\y\ 



< ll^f+ft 2 !!^!! 2 

= (i-tf)ll*T + tfNl a 

< {(i-^v + ^jii^f 

and this is smaller than /(a, ft, ft) 2 ||a;|| 2 . 

From the above two cases we conclude that ||iw|| = \\Zx\\ < /(a, ft, ft)||:E|| and 



\(G®(H 1 ,H 2 ))= max 



\\Zx\\ 



x±l MN \\X\ 



< /(a, ft, ft). 



□ 
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4.2 The Reduced Zig-zag Product 

Here we derive an upper bound for the spectral expansion of the powers of the reduced zig- 
zag product. Note that (0Q) in Theorem 14.11 is not useful for the reduced zig-zag product 
because A(0) = 1 and /(a,/3i,l) = 1. In fact X(G@'H) = 1. However the spectral 
expansion of higher powers of the reduced zig-zag product behaves as in the generalized 
zig-zag product as shown in the following theorem. 

Theorem 4.2. X(G®'H) = 1. If X(G) < a and X(H) < (3, then 

X((G®'H) k )<f'(a,0) k '\ = 2,3,... (10) 

where 

/'(a, 0) = /(a, Vft V^) = - 0) + 

proof. Let Z' be the transition matrix of the random walk on G®'H . In the same way 
as the proof of Theorem 14.11 Z' is decomposed into Z' = AB. When x — or", Pa; = x and 
hence ||Z'a;|| = ||AJ3rr|| = \\Ax\\ = \\x\\. This implies that X(G®'H) = 1. 

To prove ffTOj) . we consider a singular value decomposition: B = PHQ T where P and Q 
are orthogonal matrices and S is a diagonal matrix of the singular values of 5. We denote 
P = (pi, . . . ,p M ),Q = (<?i, • • . = diag{a 1 , . . .,a M ) and set <n = l,pi = <?i = 1 M - 

Then, since P T P = Im, we have 

B = PSQ r 

= Pv / SP T Pv / SQ T 
= : P1P2 

where Pi = PV^P T , B 2 = PV^Q T . Then, B = B X B 2 where Pi = I N 0B 1 , P 2 = I N ®B 2 , 
and for = 2, 3, . . . , we can decompose Z fk , the transition matrix of (G®'H) k , into 

Z' k = (AB) k 

= {AB 1 B 2 ) k 

= ABi(B 2 AB 1 ) k - 1 B 2 . 

Since the singular values of both P x and B 2 are the square roots of those of P, the second 
largest singular values of Pi and B 2 are both smaller than or equal to \fff. Also, since 
the left-singular and right-singular vectors of Pi , B 2 corresponding to the singular value 
yfW\ = 1 are all Pi = qi = 1m, we have PiIm = P2IM = Iju- It follows that Pi and 
P 2 have the same properties as in the proof of Theorem 14.11 when \f]3 is substituted for 
(3\ and (3 2 . Therefore we have ||P 2 ABia;|| < f(a,y/]3,y/]3)\\x\\ = f'(a, (3)\\x\\ for every 
x _L Imn- Now 

\\Z' k x\\ = \\AB 1 (B 2 AB 1 ) k -\B 2 x)\\ 

< \\{B 3 AB 1 ) k - 1 {B 2 x)\\ 

< fia^f-^xW 

< f\a,(3) k - l \\x\\ 
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and hence 

II 7'^T> II 

\{{G®'H) k )= max 11 „ „ 11 < f(a, pf' 1 . 

x±1mn \\x\\ 



□ 



5 Numerical experiments 

In this section, we compare spectral expansions for zig-zag products with their bounds 
given in Theorem 14.11 and Theorem I4.2L We use a random M-regular digraph G on the 
set of vertices [N] and D-regular digraph H on the set of vertices [M] in three cases: 



i) n = 


50, M = 


40, 


D = 


30. 


ii) N = 


-- 30, M = 


= 20 


,D = 


= 10 


iii) N -- 


= 10, M = 


= 5, 


D = 


3. 



The random graphs are generated by the following algorithm based on the configuration 
model (PS], (21J). 

Algorithm 5.1 (configulation model). In generating a random M-regular digraph G = 
(V,E) on the set of vertices [N], we take the following steps (generating H is similar): 

Step 1. Create two vectors x and y, each a random permutation of the integers from 1 
to MN. 

Step 2. Reassign all the entries in the vectors with their values mod N (integers from 1 
to N). 

Step 3. Construct the graph G by defining vertex set V{G) = [N] and edge set E{G) = 
{(x iiyi ):i = l,...,MN}. 

Also we generate 100 random two-way labellings for each G in order to define the 
zig-zag products of G and H. We do not need a two-way labelling for H here, since it is 
used to define only the two-way labelling for the zig-zag products, which is irrelevant to 
the spectral expansion of the products. Thus, we obtain 100 zig-zag products G@H = 
G@(H, H) and reduced zig-zag products G@'H in each case. 

First, we compare the spectral expansion for the zig-zag product A = \{G@H) with 
their bound / = f (X(G) , X(H) , X(H)) given in Theorem 14.11 The spectral expansion is 
computed as the second largest singular value of the transition matrix of the graph. In 
each case, we computed the average and the maximum of A. The results are shown in 
Table [U The gap between / and the maximum of A is about 0.1 in each case and hence 
the bound / is tight to some degree. Nevertheless, the gap is much larger than the range 
of A in the case (i) and (ii). We infer that the singular values of the transition matrices 
of G and H smaller than X(G) and A (if), respectively, reduce X(G@H) from our bound 
f(X(G),X(H),X(H)). 
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KG) 


X(H) 


ave A 


max A 


f 


(i) 


0.2931153 


0.3334984 


0.3692421 


0.3708440 


0.4882911 


(ii) 


0.4184724 


0.5226591 


0.5522197 


0.5606170 


0.6964135 


(iii) 


0.5909580 


0.8047379 


0.8294209 


0.8610790 


0.9155723 



Table 1: Comparison of A = X(G@H) and its upper bound / = f(X(G), X(H), \(H)) 



Next, for k — 1, . . . , 10 we compare the spectral expansion for the k-th power of the 
reduced zig-zag product X' k = X((G®'H) k ) with their bounds f'^ 1 = f'(X(G) 1 X(H)) k - 1 
given in Theorem 14.21 We show the results in Table [20 and the graphs of the results in 
Figure [Ul3l The vertical axis is the logarithm of each variables and the horizontal axis is 
the degree of power k. We can see that the rate at which X' k decreases as k increases is 
much smaller than /'. It is because X' k decreases asymptotically at the rate of the second 
largest eigenvalue (in absolute value) of Z', which is smaller than the second largest 
singular value of B2AB1 bounded by /' in the proof of Theorem 14.21 
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k 


ave X' k 


max \' k 




1 


1 


1 


l 


2 


0.3692421 


0.3708440 


0.6833770 


3 


0.1022944 


0.1053438 


0.4670042 


4 


0.0268145 


0.0284278 


0.3191399 


5 


0.0068423 


0.0069972 


0.2180929 


6 


0.0017359 


0.0017915 


0.1490397 


7 


0.0004315 


0.0004564 


0.1018503 


8 


0.0001064 


0.0001137 


0.0696022 


9 


0.0000263 


0.0000284 


0.0475645 


10 


0.0000064 


0.0000070 


0.0325045 



Table 2: Comparison of \' k = \({G® f H) k ) and its upper bound f^ 1 (N = 50, M = 
40, D = 30) 




k 


ave X' k 


max \' k 




1 


1 


1 


1 


2 


0.5522197 


0.5606170 


0.8296951 


3 


0.2304273 


0.2419442 


0.6883940 


4 


0.0942567 


0.1013095 


0.5711572 


5 


0.0377101 


0.0399611 


0.4738863 


6 


0.0149260 


0.0166791 


0.3931812 


7 


0.0058516 


0.0070592 


0.3262205 


8 


0.0022697 


0.0030180 


0.2706636 


9 


0.0008743 


0.0012554 


0.2245682 


10 


0.0003360 


0.0005136 


0.1863232 



Table 3: Comparison of \' k = X((G@' H) k ) and its upper bound (JV = 30, M = 

20,D = 10) 




k 


ave X' k 


max \' k 




1 


1 


1 


1 


2 


0.8294209 


0.8610790 


0.9566212 


3 


0.6072055 


0.6531134 


0.9151240 


4 


0.4327482 


0.4799104 


0.8754270 


5 


0.2983260 


0.3643133 


0.8374520 


6 


0.1998155 


0.2659929 


0.8011243 


7 


0.1357641 


0.1866002 


0.7663725 


8 


0.0902645 


0.1317873 


0.7331281 


9 


0.0604630 


0.0923539 


0.7013259 


10 


0.0402301 


0.0642308 


0.6709032 



Table 4: Comparison of \' k 
5,D = 3) 



\{{G®'H) k ) and its upper bound (N = 10, M 



0.1 



0.01 




Figure 3: Comparison of X' k = \((G®'H) k ) and its upper bound (N = 10, M 

5,D = 3) 
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